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Concurrency  of  development  of  the  training  subsystem  is 
rapidly  becoming  a key  concept  in  the  development  of  new  materiel  sys- 
tems. The  development  of  the  training  subsystem  must  occur  concur- 
rently with  that  of  the  prime  system,  in  order  to  meet  the  objective 
of  having  a total  system  operational  when  it  is  fielded.  This 
requires  that  the  development  of  the  training  subsystem  commence  early 
in  the  life  cycle  of  the  prime  system,  i.e.,  in  the  conceptual  stage. 
Toxi/ards  this  end  a number  of  activities  concerned  witli  concurrent 
training  development  have  been  outlined  in  such  documents  as  DA  Pam- 
phlet 11-25,  the  Life  Cycle  System  Management  Model  (13).  These 
activities  include  the  identification  of  requirements  for  training 
devices.  Once  a decision  has  been  made  that  a training  device  is 
required  (and  there  is  an  increasing  impetus  towards  utilization  of 
training  devices) , the  training  device  concept  or  alternative  concepts 
must  be  evaluated. 


Due  to  the  time  constraints  pushing  in  from  the  deadlines 
associated  with  the  ongoing  system  development,  the  training  developer 
must  make  decisions  or  judgments  early  on  in  the  process,  when  informa- 
tion available  from  the  prime  system  development  may  be  sketchy.  While 
the  development  of  the  training  device  concept  must  commence  as  soon  as 
possible  in  order  to  meet  the  required  deadlines,  particularly  on  long 
lead-time  items,  "bending  of  mo.tal"  for  prototypes  cannot  begin  before 
the  design  freeze  of  the  pertinent  segment  of  the  prime  system.  There- 
fore, assessment  of  training  device  concepts  becomes  more  dependent 
upon  the  use  of  analytical  as  opposed  to  empirical  assessment  tech- 
niques. Also,  the  rising  costs  associated  with  the  development  of  such 
devices  gives  rise  to  an  Increased  requirement  for  development  of  a 
systematic  methodology  for  the  assessment  of  such  concepts. 
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One  methodological  tool,  or  decision  aid,  which  has  been 
developed  to  assist  in  making  such  judgments  is  known  as  TRAINVICE. 

The  original  model  was  dev'eloped  for  the  Army  Research  Institute  and 
was  based  upon  an  extensive  literature  review  and  analytical  work  by  a 
team  of  experienced  behavioral  scientists  (15,  16,  17).  A revision  of 
this  model  based  upon  experience  gained  in  its  utilization  and  which 
we  may  call  TRAINVICE  II,  is  being  developed  V7lth  the  aims  of  increas- 
ing the  practicality  and  flexibility  of  its  application  and  making  the 
methodology  more  amenable  to  utilization  by  a wider  spectrum  of  users 
(9) . This  paper  will  concentrate  on  the  rationale  for  TRAINVICE  II 
and  the  difficulties  involved  in  the  development  of  a practical  model 
which  provides  for  incorporation  of  the  variable  experience  and  per- 
sonal judgmental  factors  of  the  training  developer  or  analyst  vis-a- 
vis  available  recommendations  or  guidance. 

TRAINVICE  II 

Essentially  the  model  provides  a framework  for  asking  three 
questions  concerning  a training  device  concept.  As  given  in  Figure  1, 
these  are,  "What,"  "Wliy,"  and  "How."  These  three  questions  are  asked 
for  each  unit  of  behavior  that  is  being  trained  by  the  device.  A 
training  device  represents  a cluster  of  activities,  which  become 
better  defined  as  the  concept  becomes  better  defined.  This  may  take 
the  form  of  definition  at  the  task,  subtask,  or  skill/knowledge  level, 
which  represents  the  component  physical  and  mental  activities 
Involved.  Such  a model  as  this  is  best  utilized  when  information  is 
available  to  the  finest  meaningful  level  of  detail,  as  the  required 
judgments  can  be  made  more  accurately.  However,  an  attempt  is  being 
made  to  have  the  model  accommodate  information  at  a more  molar  level 
in  order  to  Initiate  analysis  as  early  as  possible  in  the  development 
cycle.  (A  corollary  requirement  is  imposed  upon  the  meteriel  devel- 
oper to  make  detailed  information  available  as  soon  as  possible  to 
meet  the  needs  of  the  training  developer.) 

In  order  to  answer  the  question  of  "what"  is  to  be 
represented  in  the  training  device,  two  judgments  are  required.  The 
first  deals  with  the  requirement  for  the  unit  of  activity  to  be  repre- 
sented in  tlie  device,  while  the  second  ascertains  if  that  unit  is  cov- 
ered. These  two  judgments  together  have  as  their  objective  the  deter- 
mination that  the  spectrum  of  activities  covered  neither  exceeds  that 
which  is  necessary  nor  leaves  out  any  that  should  be  covered. 

The  "wliy"  question  component  deals  with  a more  detailed 
"defense"  of  the  reason  for  including  the  unit  of  activity  which  was 
deemed  to  be  necessary  in  tlie  previous  judgment  and  vjhich  is  indeed 
included,  or  is  to  be  Included,  in  the  device.  This  assessment  is 
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WHAT 

Coverage  Requirement 

Should  this  unit  of  activity  be  represented 
in  the  device? 

Coverage 

Is  this  unit  of  activity  represented  in  the 
device? 

WHY 


Training  Criticality 

What  level  of  proficiency  is  required  in 
this  unit  of  activity? 

Training  Difficulty 

How  difficult  will  it  be  to  train  for 
this  unit  of  activity? 

HOW 

Physical  Characteristics 

How  well  do  the  physical  characteristics 
of  the  device  involved  in  training  for 
this  unit  of  activity  meet  the  perceived 
requirements  and  applicable  guidelines? 

Functional  Characteristics 

How  well  do  the  functional  characteristics 
of  the  device  involved  in  training  for  this 
unit  of  activity  meet  the  applicable  guidelines? 

Figure  1.  Judgments  made  in  TRAINVICE  II 
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performed  relative  to  two  aspects;  Training  Criticality,  which  relates 
to  the  degree  of  proficiency  required  at  the  end  of  the  training,  and 
Training  Difficulty,  which  considers  the  degree  of  difficulty  to  be 
expected  in  training  to  reach  the  desired  level  of  proficiency.  I'/hen 
these  factors  are  assessed  quantitatively,  these  judgments  in  essence 
give  a weighting  to  each  required  unit  of  activity  covered  by  the 
device.  It  should  be  noted  that  the  decisions  concerning  "what"  may 
have  to  wait  upon  or  be  changed  by  feedback  from  the  decisions  con- 
cerning "why"  an  activity  unit  should  be  included  in  the  device, 
depending  upon  the  stage  of  development  of  the  device  concept. 

The  first  two  questions  dealt  with  an  assessment  of  the 
spectrum  of  activities  to  be  covered  by  the  device,  and  not  with  how 
these  activities  were  to  be  taught  or  conveyed  by  the  device;  the  last 
question  "how"  deals  with  this  aspect.  The  "how"  question  considers 
two  aspects;  do  the  physical  characteristics  of  the  device  follow 
available  guidelines  of  "good  practice"  and  do  they  fit  the  perceived 
requirements  of  the  training  device  developer,  and  are  these  physical 
characteristics  utilized  in  keeping  with  available  guidelines  for 
"good  practice";  are  their  functional  characteristics  such  as  to  make 
for  good  training? 

The  assumption  is  being  made  that  the  potential  for  transfer 
of  training  will  Increase  as  a function  of  the  degree  to  which  the 
required  activities,  physical  and  mental,  are  represented  in  the 
device  and  the  degree  to  which  the  training  device  follows  "good" 
practice  in  training  in  these  activities.  In  addition,  each  of  the 
activity  units  is  appropriately  weighted  by  the  degree  of  skill 
required  and  the  degree  of  difficulty  Involved. 

At  this  point  it  may  be  well  to  discuss  the  utilization  of 
the  model  for  both  prescriptive  and  predictive  purposes.  It  is  hoped 
that  such  a model  as  TRAINVICE  II  can  be  utilized  for  both  purposes, 
in  keeping  with  the  objective  of  utilization  as  early  as  possible  in 
the  development  cycle.  A prescriptive  utilization  would  be  for  the 
a priori  formulation  of  the  training  device  concept;  predictive  utili- 
zation would  be  the  application  of  the  model  to  an  existing  training 
device  concept  or  prototype  to  predict  the  effectiveness  of  transfer 
of  training  which  is  to  be  expected  through  use  of  the  device.  Wlien 
Information  is  Incomplete,  due  to  the  stage  of  development  of  the 
prime  system  or  the  training  subsystem,  the  prescriptive  mode  takes  on 
added  importance.  This  aspect  will  be  touched  upon  as  we  now  go 
through  the  model  in  more  detail. 

Coverage  requirement  analysis.  The  first  judgment  to  be 
made  is  whether  cacli  of  the  skills  (or  knowledges)  subsumed  under  the 


NARVA 


i 


i 

I 

I 

I 

[ 

t 

i 


I 


I 


training  objective  should  or  should  not  be  included  in  the  training 
situation.  Depending  upon  the  stage  of  development  of  the  training 
device,  this  analysis  may  help  to  delineate  the  range  of  skills  to  be 
represented  in  the  device  (the  prescriptive  mode) , as  well  as  assess- 
ing the  range  of  skills  represented  in  a device  (the  predictive  mode). 
The  judgments  may  be  recorded  simply  in  the  form  of  a checklist,  or, 
if  a quantitative  prediction  is  to  be  attempted,  through  the  use  of  1 
or  0,  to  indicate  a requirement  for  a skill/knowledge,  or  lack  of  a 
requirement,  respectively.  This  analysis  is  a "gate"  only;  it  deter- 
mines if  the  skill  should  be  represented  in  the  training. 

Coverage  Analysis.  The  second  judgment  is  made  by  comparing 
the  skills  which  have  been  judged  to  be  required  to  be  included  in  the 
training  with  those  that  indeed  are  included  in  the  training  device 
concept.  This  judgment  may  not  be  possible  to  make  in  the  prescrip- 
tive mode,  before  a training  device  concept  is  formulated;  however,  it 
could  take  the  form  of  a checklist  to  be  utilized  as  the  concept  takes 
form,  to  ensure  that  all  the  required  skills  are  included.  In  the 
predictive  mode,  when  an  existing  concept  is  being  assessed,  a "1"  may 
be  assigned  rather  that  a checkmark,  and  a "0"  utilized,  ratlier  than  a 
lack  of  a checkmark,  in  order  to  feed  into  the  overall  index  of  pre- 
dicted training  device  effectiveness  which  will  be  subsequently 
derived. 

If  the  coverage  requirement  rating  is  "1"  and  the  coverage 
rating  is  "0,"  this  would  indicate  that  training  in  this  skill  is 
lacking  and  steps  should  be  taken  to  include  it  or  the  device  will 
suffer  in  its  overall  rating.  On  the  other  liand,  if  the  coverage 
requirement  rating  is  "0"  and  the  coverage  rating  is  "1,"  this  would 
indicate  that  unnecessary  training  is  being  provided  and  should  be 
eliminated  from  the  device,  or  its  overall  rating  will  also  suffer. 

Training  Criticality  Analysis.  For  each  of  the  skills  that 
have  been  judged  to  be  necessary  to  be  represented  in  the  training 
situation  and  are  indeed  represented,  a judgment  is  made  as  to  the 
degree  of  proficiency  required  in  that  skill  at  the  end  of  training. 

In  the  predictive  mode,  for  the  assessment  of  an  existing  concept,  the 
following  rating  scale,  adapted  from  Demaree  (3),  is  used: 
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Should  have  limited  knowledge  of  subject  or  skill 

Should  have  received  complete  briefing  on  subject  or 
skill 

Should  have  understanding  of  subject  or  skill  to  be 
performed 

Should  have  complete  understanding  of  subject,  or  be 
highly  skilled 
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In  making  this  judgment,  the  analyst  must  take  into  account  the  nature 
of  the  skill  and  the  degree  to  which  the  training  x«7ill  be  supplemented 
by  subsequent  on-the-job  training. 

This  rating  could  also  be  used  in  a prescriptive  mode,  in 
making  decisions  concerning  which  of  the  skills  is  to  be  represented; 
in  working  back  to  the  coverage  requirement  decision. 

Training  Difficulty  Analysis.  In  addition  to  assessing  the 
level  of  proficiency  required  for  each  of  the  required  skills,  a judg- 
ment is  made  of  the  degree  of  difficulty  which  Is  to  be  expected  in 
attaining  that  level  of  proficiency,  for  the  particular  skill  and 
trainee  population  Involved.  In  the  predictive  mode,  the  following 
rating  scale,  adapted  from  that  of  Rankin  (11),  is  used: 

1 Minimal  or  none 

2 Some 

3 Much 

4 Substantial 

The  various  factors  which  must  be  considered  by  the  analyst 
in  making  this  decision  are  not  explicitly  delineated  or  extracted  for 
judgment,  but  must  be  integrated  Into  the  judgmental  process.  These 
factors  are  the  required  level  of  proficiency,  the  level  of  skill 
existing  in  the  trainee,  and  the  Inherent  level  of  difficulty  of  the 
activity  per  se.  The  analyst  must  rely  upon  his  own  experience  or 
knowledge  concerning  the  difficulty  involved  In  training  the  various 
skills  or  rely  on  others  who  do  have  the  experience,  or  attempt  to 
extrapolate  from  available  knowledge  concerning  related  skills. 

As  was  the  case  for  training  criticality,  this  rating  may  be 
used  in  a prescriptive  mode,  in  making  decisions  concerning  whicli  of 
the  skills  are  to  be  represented;  in  working  back  to  the  coverage 
requirement  decision. 

Physical  Characteristics  Analysis.  Having  considered  what 
skills  are  covered  by  the  training  device  concept,  and  why,  we  now 
turn  to  a consideration  of  how  these  skills  are  to  be  taught.  The 
first  judgment  in  this  respect  Is  that  concerning  tlie  physical  charac- 
teristics of  the  device. 

A training  device  may  be  considered  to  be  a mosaic  of 
specific  elements,  be  they  displays,  controls,  inputs,  outputs,  or 
cue-response  pairs.  These  elements  may  be.  likened  to  the  simulation 
elements  proposed  by  Smode  (12),  with  the  configuration  and  operation 
of  the  training  device  determining  the  spatial  placement  and  temporal 
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sequencing  of  the  elements.  As  Matheny  (8)  has  pointed  out,  the 
assumption  may  be  made  that  it  is  perceptual  equivalence  that  results 
in  positive  transfer  from  the  training  to  the  operational  situation, 
and  it  is  the  adequacy  of  these  simulation  elements  in  terms  of  per- 
ceptual or  psychological  equivalency,  not  physical  equivalency,  which 
must  be  judged.  The  totJil  training  device,  and  indeed  each  of  the 
elements  embedded  in  that  mosaic,  may  be  considered  to  lie  within  a 
space  defined  by  the  dimensions  of  fidelity  and  abstraction.  Levels 
of  abstraction  range  from  the  real  world  to  mathematical  models  repre- 
senting dynamics  taking  place  in  that  vjorld,  they  are  analogies  of 
the  real  world,  while  fidelity  varies  as  to  the  comprehensiveness  and 
level  of  detail  to  which  the  external  world  is  represented  (5,  10). 

In  order  to  deal  v/ith  the  multiplicity  of  degrees  of  abstraction  and 
fidelity  with  which  training  devices  may  clothe  themselves,  it  was 
deemed  necessary  to  translate  the  specific  simulation  elements  into 
generic  characteristics.  This  brings  the  number  of  specific  possible 
forms  that  each  element  may  assume  into  manageable  proportions  and 
provides  for  a common  base  upon  which  to  make  the  required  judgments 
concerning  the  stimuli  and  responses,  or  physical  characteristics  of 
the  training  device.  Such  a listing  has  been  taken  from  that  given  in 
the  TECEP  technique  of  Braby,  fQ  (2),  and  is  shown  as  Figure  2. 

The  analyst  must  make  a judgment  as  to  what  generic 
characteristics  are  required  and  rate  the  existing  generic  character- 
istics against  this  criterion.  In  order  to  make  this  judgment,  he 
must  draw  upon  his  own  perceived  requirements  for  each  of  the  dements, 
or  turn  to  others,  either  directly  or  through  reference  to  available 
guidelines,  or  both.  Some  guidance  may  be  gleamed  from  the  litera- 
ture. However,  a simplified  version  of  the  Aagard  and  Braby  guide- 
lines which  is  utilized  in  the  ISD  model  (1,  14)  appeared  most  suit- 
able and  has  been  adapted  for  use  with  the  TRAINVICE  II  model  to  give 
some  guidance  to  the  analyst  in  making  the  judgments  concerning  the 
physical  characteristics,  in  conjunction  with  his  o\ai  perception  of 
the  requirements.  However,  these,  guidelines  were  Intended  for  utili- 
zation in  instructional  system  development  and  instructional  delivery 
system  or  media  selection,  and  not  for  scrutiny  of  specific  aspects  of 
a training  device.  The  development  of  more  specific  guidelines  is 
needed.  These  guidelines  deal  for  the  most  part  witli  functional 
aspects  of  the  training  situation,  such  as  the  sequencing  of  learning 
events.  However,  selected  guidelines  may  be  extracted  as  being  appli- 
cable to  the  design  of  specific  elements  of  the  training  device  or 
situation. 


The  procedure  followed  in  performing  the  physical 
characteristics  analysis  Is  shown  in  Figure  3.  For  most  effective 
utilization  of  the  model,  task  information  down  to  the  skill/knov.;lodgo 
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STI^^ULUS  CAPABILITIES 


Visual  Form 


Scale 


1. 

Visual  Alphanumeric 

13.  1 

2. 

Visual  Pictorial,  Plane 

14.  ' 

3. 

Visual  Line,  Plane 

4. 

Visual  Object,  Solid 

Audio 

5. 

Visual  Environment 

Visual  Movement 

15.  ' 

16.  : 

6. 

Visual  Still 

17.  . 

7. 

Visual  Limited  Movement 

8. 

Visual  Full  Movement 

Other 

9. 

Visual  Cyclic  Movement 

18.  ' 

Visual  Spectrum 

19. 

10. 

Black  and  White 

20.  ; 

11. 

Gray  Scale 

12. 

Color 

TRAINEE 

RESPONSE  MODES 

21. 

Covert  Response 

28.  : 

22. 

Multiple  Choice 

23. 

Pre-programmed  Verbal 

29.  ' 

24. 

Free-Style  Written 

30.  : 

25. 

Decision  Indicator 

26. 

Voice 

27. 

Fine  Movement 

Motion  Cues 


Motion  Cues 


Manipulative 


Manipulative 


Manipulative 


Figure  2.  Generic  Characteristics  List 


Assign  skill/knowledge  J 

to  behavioral  category  ^ Refer  to  physical  ^For  each  display/control 
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Figure  3.  Physical  Characteristics  Analysis 
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level  should  be  available.  The  reason  or  I'.'.ir,  is  t hat  the  j^uldf  I incs 
are  accessed  through  means  of  behavioral  categories;  t;h(tre  ;i  s a dif- 
ferent set  of  guidelines  for  each  of  the  behavioral  ca I egories^  and 
the  skill/knowledge  involved  must  be  translated  into  a liehavioral  cat- 
egory. If  an  analysis  is  done  at  the  subta'-k  level,  more  than  one 
behavioral  category  may  be  involved  and  more  guideline.^  must  be  con- 
sidered. Also,  for  each  of  the  skills,  information  concerning  tlic 
displays  and  controls  involved  in  implcmen!'.. tion  of  (liat  skill  should 
be  available,  as  It  is  the  generic  characteristics  of  tliese  controls 
and  displays  which  are  to  be  assessed.  In  the  predictive  mode,  each 
of  the  generic  characteristic.s  associated  . i th  each  of  the.  dlfgilays  or 
controls  (or  cues  and  responses)  is  rated  ■ -ing  the  scale,  shown  in 
Figure  3.  Therefore,  each  of  the  displays  .rr  control.s,  or  jdiy.sical 
characteristics,  receives  a physical  characteristics  score  vdrich  is 
the  total  of  the  ratings  given  on  the  applicable  generic  characteris- 
tics. In  addition,  the  innxiinum  rating  is  erven  for  each  of  tlie.  appl  i 
cable  parameters  in  order  to  provide  a base  for  assessment  of  tlie 
device  in  the  index  subsequently  calciilateu.  The  pattern  of  these 
ratings  may  serve  to  "highlight"  the  various  physical,  characteristics 
of  the  device,  both  those  that  are  outstanding  and  those  tliat  need 
change.  In  addition,  each  of  the  characteristic?  may  require  a justi- 
fication in  order  to  control  for  the  introdjction  of  imneeded  fea- 
tures. In  order  to  derive  the  Pliy.sical  iltaractcri sties  rating  for  the 
skill  involved,  the  ratings  given  on  each  cv  i.he  displays  or  controls 
are  added  to  give  the  total  for  that  skill.  Therefore,  the  presentee 
of  a "0"  rating  does  not  eliminate  that  ski.l]  .from  tlie.  total  rating 
but  does  serve  to  downgrade  the  total  rating  for  the  .skill  and  subseq- 
uently for  the  dev^ice. 

If  information  concerning  the  .spcc.:frr.  characteri  .st  ic.s 
of  the  displays  or  controls  involved  is  hol  available  due  to  the  stage 
of  development,  the  ratings  may  fall  back  'c  a prescriptive  mode,  in 
which  the  desired  generic  characteristics,  g.t.s.sibly  I Itrough  use  as  a 
checklist,  arc  chosen.  In  lieu  of  performing  an  assessment  of  exi.stlng 
generic  characteristics.  This  is  a similar  procedure  to  that  utilized 
In  the  TKCEP  technique  of  Braby  ^ a]_  (2).  'he  TECEP  tc'chnique  gives 
recommendations  as  to  vdiich  delivery  syste  ■,  including  generic  elassc.s 
of  training  devices,  permit  the  applic.U  ion  of  the  learning  g,uide1ine!, 
for  each  of  the  behavioral  categories;  reccminenda 1 1 ons  b.ised  upon  the 
pattern  of  matching  of  the  gevicric  cha raci  er iotics  inherent  in  I Ik 
various  delivery  systems  and  those  judged  r.oecssary  by  the  annly.st  . 
Jorgensen  (6,  7)  has  utilized  a similar  matrix  approach  in  which  the 
generic,  characteristics  judged  as  being  renji’'cd  are  matched  against 
various  media,  of  which  training  devices  ar..  me  c.las!:,  in  orde.r  to 
select  training  media  most  suitable  for  training  various  ta.sks.  How- 
ever, these  procedures  are  intended  for  the  election  of  or  eomjiar i son 
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of  various  media  or  instructional  delivery  systems  rather  than  the 
scrutiny  of  a training  device  per  se  or  comparison  of  training 
devices . 


Functional  Characteristics  Analysis.  While  the  physical 
characteristics  analysis  is  concerned  with  the  analysis  of  the  ele- 
ments of  the  training  device  per  se,  the  functional  characteristics 
analysis  is  concerned  with  how  these  elements  are  utilized.  The 
operation  of  the  device  is  compared  against  guidelines  to  ascertain  to 
what  extent  "good"  training  practices  are  followed.  Once  again,  these 
guidelines  are  those  extracted  from  the  ISO  model  (14) . 

The  procedure  followed  in  performing  the  functional 
characteristics  analysis  is  shown  in  Figure  4.  As  with  the  physical 
characteristics  analysis,  each  of  the  skills  is  translated  into  a 
behavioral  category,  which  dictates  which  set  of  guidelines  is  to  be 
utilized.  The  set  of  guidelines  is  consulted  as  the  functional, 
dynamic  characteristics  of  the  elements  Involved  in  training  for  that 
skill  are  considered.  In  the  predictive  mode,  each  of  the  guidelines 
judged  to  be  pertinent  to  the  particular  situation  involved  is  rated, 
using  the  scale  shown  in  Figure  4.  A judgment  is  made  to  the  extent 
that  that  guideline  is  implemented  by  the  functioning  of  the  cluster 
of  elements  used  to  implement  training  for  that  skill.  In  order  to 
derive  a Functional  Characteristics  rating  for  the  skill,  the  ratings 
are  added  to  give  the  total  for  that  skill.  Therefore,  the  presence 
of  a "0"  rating  does  not  eliminate  that  skill  from  the  total  device 
rating,  but  docs  serve  to  downgrade  the  rating  for  the  skill,  and  sub- 
sequently of  the  device,  and  may  also  serve  to  "flag"  some  aspect  that 
needs  to  bo  corrected.  In  addition  the  number  of  applicable  guide- 
lines are  multiplied  by  "3,"  the  highest  possible  rating,  to  give  a 
baseline  against  which  the  derived  rating  may  be  compared  in  the 
subsequent  device  index. 

If  sufficient  information  is  not  available  to  make  the 
required  ratings,  the  procedure  may  revert  to  the  prescriptive  mode, 
in  which  the  applicable  guidelines  are  selected,  and  utilized  as  a 
checklist  for  the  development  of  the  training  device  concept.  If  the 
analysis  must  be  performed  at  the  subtask  level , then  more  guidelines 
must  be  sorted  out  and  consulted,  as  a larger  unit  of  activity  is 
involved,  which  may  encompass  more  than  one  behavioral  category. 

Derivation  of  Index  of  Predicted  Training  Device 
Effectiveness.  In  the  predictive  utilization  of  the  model,  an  index 
is  derived.  This  index  follows  a procedure  discussed  by  Gagne,  Foster 
and  Crowley  (4).  V.Hiile  not  based  on  one  of  their  formulas  directly, 
it  is  in  keeping  with  their  conclusion  that  the  most  useful  and 
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practical  type  of  formulation  is  that  based  on  percentage  of  maximum 
possible  transfer.  It  assumes  that  if  the  device  were  to  follow 
perfectly  all  of  the  guidelines,  as  judged  necessary  by  the  analyst, 
that  maximum  transfer,  which  could  be  attributed  to  the  device,  would 
be  the  result.  This  forms  the  baseline  against  which  the  device  under 
evaluation  is  compared.  This  score  is  weighted  by  the  Coverage 
Requirement,  Coverage,  Training  Criticality  and  Training  Difficulty 
scores  derived  for  that  skill.  The  derived  score  for  each  skill  is 
compared  with  the  score  representing  maximum  expected  transfer.  (If  a 
"0"  rating  is  given  for  either  the  Coverage  Requirement  or  Coverage 
Analysis,  the  total  score  for  that  skill  is  reduced  to  "0"  and  makes 
no  contribution  to  the  derived  index  for  the  device.)  To  derive  the 
score  for  the  total  device,  each  of  the  skill  scores  is  added.  There- 
fore, the  index  of  predicted  training  device  effectiveness  is  as 
follows : 


Z(CR  X C X Ci  X D X (PC  + FC))i 

Z(CR  X C X Ci  X D X (PC„,^  + FC„^  ))i 
' ' max  max'^ ' 


where: 


CR  Coverage  Requirement  Score 

C Coverage  Score 

Ci  Training  Criticality  Score 

D Training  Difficulty  Score 

PC  Physical  Characteristics  Score 

PC  Functional  Characteristics  Score 

PCmax  Maximum  Possible  Physical  Characteristics 
Score 

FCmax  Maximum  Possible  Functional  Characteristics 
Score  for  each  skill. 


This  equation  will  yield  an  index  ranging  from  0 to  1.  The 
larger  the  index,  the  larger  the  number  of  required  skills  represented 
and  the  higher  were  the  ratings  given  on  the  Device  Characteristics 
Analyses;  therefore,  presumably  the  greater  the  potential  for  transfer 
of  training. 

Conclusions 

(1)  Due  to  the  increased  emphasis  on  the  concurrent 
development  of  training  subsystems,  the  increased  impetus  towards  the 
utilization  of  training  devices,  and  the  rising  costs  associated  with 
the  development  of  such  devices,  there  is  a need  for  the  development 
of  a systematic  analytical  methodology  for  the  assessment  of  training 
device  concepts  which  may  be  applied  early  in  the  development  cycle  of 
the  materiel  system. 
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(2)  Such  a methodology  must  permit  the  integration  of  the 
variable  judgmental  processes  of  the  training  developer  and  available 
guidance . 

(3)  A model  has  been  described  which  provides  a framework 
for  the  application  of  judgmental  data  concerning  aspects  of  the 
training  situation  which  have  been  hypothesized  as  having  an  Impact 
upon  the  effectiveness  of  transfer  from  the  training  to  the  opera- 
tional situation.  Judgments  are  made  concerning  coverage  of  required 
skills,  the  weighting  to  be  assigned  to  these  skills  from  the  aspects 
of  training  criticality  and  difficulty,  and  the  effectiveness  with 
which  the  physical  and  functional  characteristics  of  the  training 
situation  follow  guidelines  of  good  practice. 

(4)  In  order  to  apply  such  a methodology  as  early  as 
possible  in  the  development  cycle,  a prescriptive  mode  of  utilization, 
concerned  with  assisting  in  the  formulation  of  training  device  con- 
cepts, is  provided  for. 

(5)  There  is  a need  for  the  development  of  more  specific 
guidelines  which  may  be  applied  to  the  assessment  of  training  device 
concepts. 
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